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ABSTRACT . " . ' 

Fifty-eight undergraduate and graduate student 
volunteers patticipated in a factorial experiment designeid to test 
^hypotheses about the effects of two levels of information 
organization and four types of adjunct prequestion treatments on 
performance on specific amount items and two types of items organized 
in the same manner as the graphical stimuli used. .Significant 
organization x item txpe and prequestion x item type interactions 
suggest that these variables may differentially facilitate 
"performance on- the kinds of items used in this experiment. Potential 
implications for the educational use of graphical displays and 
suggestions for future research are presented and discussed. 
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Fifty-eight undergraduate and graduate student volunteers 

participated in a factorial* experiment designed to test hypotheses about 
the effects of two levels* of information organization and four types of 
adjunct pre-question treatments on performance on specific amount items 
and two types of items organized in the same manner as the graphical stim- 
uli used. "Significant organization x item type and pre-question x item type 
interactions suggest- that these variables may differentially facilitate per- 
formance an the kinds of items used in this experiment. Potential 

> 

implicatibns for th$ educational use of graphical displays and suggestions 
for futuri research are presented and discussed. 
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V Recent research has shown that the organization of information in 

a prose passage (e.g., Frase, 1969; Friedman & Grietzer, 1972; Meyers et al. 1972) 
and the use of adjunct aids, particularly the use of pre- and pos^questions 
embedded in the passage (e.g., Rqthkopf, 1966; Frase, 1968) are two variables 
which signifi-ntly affect the acquisition of information presented in prose 
form. While pfose is the primary printed medium for presenting many kinds 
of information,, graphs and tables are frequently used where quantitative 
information is involved. Yet, very few studies can be found in the liter- 
ature which deal with the acquisition of information from these kinds of 
displays. The purpose of this study was to see whether these two variables, 
which have such a marked influence on prode learning, play a similar role 
in learning from graphical displays. The only publi'shed study dealing 
directly with this question was reported by Washbume (1927) . 

Washbume examined the effects of two types of graph organization 
'^on performance on three types of test items: (a) specific ainount items, 
requiring recall of the price of a particular product at a particular point 
in time, (b) static comparison items, requiring comparison .of the prices 
of two or more products at the same point in time, and (c). dynamic comparison 
items', requiring the comparison of price trends or the relative f luctuation^n.- 
theprices of two or more products over a specific time interval. For con- 
venience, we will refer to Washburne's two types of graph organization as 
static and dynamic organization. In bar graphs having a static organization, 
-xie bars depicting the prices of the different products are clustered 
together for each time point included in the display. In bar graphs having 
a dynamic organization, all bars depicting the prices of the smne product 
at different times. are clustered together so that the price trend per 
product across successive years is perceptually salient. Washbume* s 



data suggest that these two types" of orgatiizatipn do not differentially 
affect performance on specific amount and dynamic comparison items, but 
static drganization seems to facilitate performance on static comparison 
items. . 

Tfie failure of dynamic organization to facilitate peirformanca 
on dynamic , comparison items is somewhat puzzling." iTsubjects encode bar 
graph information as it appears in. the display; the spatial proximity of 
the bars as well as the gestalt of each cluster in a graph having dynamic 
organization should facilitate per fo nuance. on items dealing with trend 
' information as compared to a graph having static organization. Perhaps 
the explanation for Washbume's result with dynamic comparison items lies 
in the relative difficulty of the items used. Price, Martuza, and Grouse 
(in'press) have shown that item difficulty is, tp a large extent, dependent 
on the number. of data points which must be recalled to answer an item 
correctly. ,To control for this possible confound in the present study, 
two-point static comparison and two-point trend items were used instead 

/ - 

of the static and dynamic comparison items employed by Washbume. Assuming 
subjects encode the information as it is organized in the display, the 
static organization graph was expected to facilitate performance on the 
two-point static comparison items while the dynamic organization graph 
was expected to facilitate performance on two-point trend items. Since 
each specific amount item depends on the recall of just one data point 

«»,d b_ecause the graphs used, in the present study_^ regardless of organiza- 
tion, did. not differ appreciably with respect to either the number of 

\ clusters of data points (bars) to be encoded or the number of data points 
per cluster, the two levels of organization were not expected to differ- 
'entially affect performance on specific amount items. 
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• In. the same study, Washburne included several treatment conditions 
in which graphical and tabular displays were accompanied by a. set of static . 
comparison study questions. When used with a tabular display, these static > 
comparison adjunct questions seemed to facilitate performance on static 
comparison test items, interfere with perfonpance on dynamic comparison 
items, and exercise no effect on specific amount items. In conditions where 
static comparison adjunct questions were used with a. bar graph or pictograph 
having a static organization, no additional increment in static .omparison 
criterion test performance was obtained, suggesting that adjunct ?t.estions 
and organization may influence the encoding process in a similar way. The 
effects of static comparison adjunct questions on the acquisition" of infor- 
mation from graphs with dynamic organization and tlie effects of other types 
of adjunct questions '(e.g., dyniinic comparison, specific amount) on infor- 
mation acquisition from other types of visual display* have not been studied 
to date. Thus, the second purpose of this study was to extend Washburne' s 
findings by examining the effects of four adjunct prequestion conditions - 
(1) two-point statid comparison itpms only, (2) two-point trend questions 
only, (3) a combination of two-point static comparison and trend items, 
and (4) irrelevant items — on acquisition of information from bar graphs 
having static and dynamic organization. Since the adjunct question litera- 
ture ^suggests that these adjunct question conditions should affect perform- 
ance somewhat differently on the three item types employed, a treatment by 

" . . .. >f 

it**m type interaction was expected. 

Subjects . Sixty-eight undergraduate education stadents who had volunteered 
for the Experiment were randomly assigned in nearly equal numbers to 16 
treatment conditions. Ten Ss were excluded prior to data analysis, for 
failure to follow directions or to correctly answer the adjunct questions 
based on the sample graphs in their booklets. "As a result, the analysis 



ts based on a sample of 58 Ss» with cell ns ranging from one to five. 
Materials. All materials presented to Ss were organized into a booklet. 
Direccicns, a sample graph, and a set of adjunct questions appeared on the 
first page, the test graph appeared on the next page, and the retention" test 
followed. 

Four test graphs, depicting the prices of three fibers in four 
different years were constructed in the following manner: A data matrix 
of 12 cells (3 fibers by 4 years) was constructed. Cell entries were 
obtained from a table of random numbers. With these values, one graph was 
constructed in which the bars were grouped according to fiber (dynamic 
organization) and one graph was constructed in which the bars were grouped 
according to year (static organization) . The values in the data matrix 
were then randomly reordered and two parallel form graphs were constructed 
using these values; one having static organizatipn, the other ^having 
dynamic organization. The purpose for using these parallel forms was 
to increase the generablizability of results and to minimize idiosyn- 
cratic task-specific effects, * 

The organization of the sample gr&ph in e'ach booklet was the . ' 
same as the organization of the test graph for that booklet. The sample 
graphs depicted the prices of two grains in each of three years and were, 
constructed using. the procedure described above for the test graphs. 

Each sample graph was accompanied by a four-item set of adjunct 
• pre-questions which defined the four levels of the adjunct pre-question 
independent variable. The four' levels were: (1) static comparison 
questions (requiring comparison of the prices associated with two products 
In ono year) e.g., : 
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In 1910 the difference between the price of corn and the price 
of wheat was: 

a) ' 1 cent per pound ot less ^ c) 4 or 5, cents per pound 

b) 2 or .3 cents per pound ' d) 6 or more cents per pound 

* » ■ • 

(2) trend questions (requiring comparison of the prices associated with one . - 

product in two years) e.g.: 

From 1910 to 1920 the difference in the price o/ com was: 

a) 1 cent per pound or less c) 4 or 5 cents per pound 

b) 2 or 3 cents per pound d) 6 or more cents per pound 

(3) sombination que s^t ions (two static comparison questions and two trend, 
questions) and (4) irrelevant questions (questions i^related to graph 

content) e.g. : - ^„ 

• 

When I see graphs in texts, I study them carefully. 

a) almost always 

b) usually " " . 

c) seldom 

For both static comparison and trend questior wo types of items 
were constructed: One type measured interval -level pro jssing of the stim- 
ulus data and one type measured ordinal-leA^el processing. Interval questions 
were of the type, presented above, while ordinal questions were of the follow- 

ing type: _ \ 

From 1900 to 1904 the price of com: 

a) increased 

b) stayed the same 

c) decreased 

Directions accompanying the first three sets of adjunct questions 
stressed that the adjunct questions- were like the test items and encouraged 
Ss to study the test graph so as to maximize performance of these types of 
questions. Ss who received irrelevant questions thus had no knowledge of 

« 

type of test item' to expect. 

The dependent variable was a retention test ^consisting of one sub- 
test of 18 interval items ano one subtest of 18 ordinal items. Within each 
subtest equaV numbers of three kinds of questions were included: (1) static 
. comparison qt^estions, (2) .trend questions, and. (3) specific amount questions 



The latter had the following form: 

In 1100 the price of linen was 

a) 1 cent or less per cunce d) 6 or 7 cents per ounce 

b) 2 Or 3 cents per ounce e) . 8 or 9 cents per ounce , 

- c) 4 or 5 cents per ounce f) 10 or more cents per ounce 

In one-half of the booklets. The interval-item subtest appeared first on the 
retention test; in the other half, the ordinal- jn subtest appeared first. 
Procedure . Each subject was given a booklet ana told to read the directions 

^^^^^^^^^^^^^^^^ ' • • 

and answer the adjunct ques't ions provided. After answering the&e questions 
Ss were given three minutes to stu^y the test £,caph, after which they were 
given whatever time they needed to ccmpl^ete the test without referring to 
the expefimental graph. Upon completing the test, Ss were given verbal . 
directions to write a description of the strateaies they used to study the 
information in the esqperimental graph. » 

Design . Two types of gratph organization (static, dynamic) ; four types of 
adjunct questions (static comparison, trend, combination, irrelevant) ; two 
parallel graph forms (i, II) and three types of test questions (static 
•comparison, trend, and specific amount) resulted in a 2 x 4 x 2 x 3 factorial 
design with repeated measures on the last factor. Separate mixed model 
Malyses of variance were performed on the data obtained from each subtest 
.(i.e., the interval -level and ordinal-level subtests). 
• • ' Results and Discussion ' 

' At the outset, it is important to note that 62 % of the subjects, regard- 
" less of treatment group membership, reported using a point learning strategy 
while studying the graphical stimuli used in this experiment. That is, most 
subjects tended to memorize lists of data point values and the associated 
data point labels for use in answering the subsequent criterion test questions. 
Evidently most subjects perceived .this point information memorization stra- 
tegy as the most efficient and effective procedure for encoding this type of 



Infonoatlon. With this in mind, consider "the results of the interval item sub- 

* ♦ * ^ * 

test analysis. * ^ 

The only significant result observed in this analysis was the main 
effect of i^em type. The Newman-Keuls procedure' was used to make all possible . 
pair-wise comparisons. The results (Table I) showed that mean performance on 
the specific amount items significantly exceeded mean performance on each of 
the rawining two item types. Since iioth- the static comparison and trend items 

• • •'' . » 

require the recall of two data points, 'while the specific amount items are based 



Table I about hSre 



on just one data point', and because most Ss reported a point memorization " 
learning strategy, this finding seemg. quite reasonable and is consistent with 
findings, reported by Martuza and Wolfe (I'SyS) and Martuza, Price, and Grouse 
(in press)* 

All other interval level results were non- significant, probably 
because, of the difficulty of the task. Although the cell means (rabl€ I) 
indicate above chance performance in all treatment conditions, the magnitudes of 
these Cleans suggest that the Ss experienced a great deal of difficulty with 
the task, perhaps because of .tii'e three iinute limit on stpdy time employed 
here. If thi& explanation is correct, the expected effects should material- 
ize on the ordinal level siibtest because ordinal level items measure a lower' 



level of ^acquisition. . Let us now consider these results. 

None of the ordinal level main effects were significant; however, 
the organization by item type, pre-question by item type, and graph form 
by item type interactions were significant. 

Turning first to the organization X item type interaction, the 
cell means in Table II indicate that performance on the specific amount and 



Table II about here 
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trend leems Is not differentially, affected by organization, while static^ 
organization seems to facilitate performance and dynamic organization ... ^ 
seems to interfere with perfo.rmance on. static comparison items (t « 2.30; 
within cells df =*126; p < ,05). These data are quite consistent with 
Washbume*s and, taken together, suggest tKe possible existence of a 
* trend information learning set. BecauSe of past experience with graphical 
displays, Ss may have formed a learning set wh^ch influencfs their 
encoding of point information in a way that facilitates subsequent 
retrieval for answering trend questions. Thus, when presented wi,th 

dynamic organization, Ss are oriented both by learning set and by organiza-, 

• • ^ ^ ^ ■ - • 

tion towards trend information; whereas, when presented with static organ- 
izati^n, ^s ar^* oriented by a learning set towards trend information but 
are oriented by organization to static coroparison information as well. 
.The net result is equivalent trend item performance under both conditions, 
but increased static con^arison performance in the static organization con- 
dition. One must keep in mind that this explanation must still be regarded 
as speculative- at this time; further study is required before firm con- 
elusions about this phenomenon can be reached. It remains to be* seen 
whether similar findings will result with: (a) increased study time, 
(b) bar graphs based on greater amounts information, (c) bar graphs 
in which different organizations result in markedly different numbers or 
sizes of the clusters of bars, or (d) other types of graphical displays. 
However, under conditions approximately like those employed in Washburne*s 
and our study, staitic organization of bar graph information is preferred 
because it results in performarice equal to or better than that obtained 
using dynamic organization on all item types used so far. 

A second important effect was th6 significant pre-question X 
item type interaction. First', the correlation between the. specific amount 



item means and (he means of Che two<9point items (i.e., the means o£ tlie 

static comparison and,, trend item performances), regarding the pre-question 

• . . • * ? " . 

treaWenV conditions as , the sampling units, is significant (p « 0.04, 

permutation test) and provides additional, evidi^nc.e „of the dependence of • 

two-point item performance on specific amount learning. . Second, mean * 

8peci£j.c amount performance in the statjlc comparison pre-question group \ 

v4s significantly lower than the unweighted mean of the specific amount 

item means obtained in the other three pre-question treatme^it conditions - 

(Sonferroni t = 2.64, within cells, df = 126, p < .05). An examination of 

the post-experiment ipquiry indicated that the proportion of Ss employing, 

a points learning strategy did not differ significantly among the four 

groups in the experiment; thus,, it appears that the S^s in the static ^ 

comparison pre-question group simply did a poor Job of learning the point information 

(See Table III). Whether this phenomenon can be attributed to intelligence- 

or some otlier pertinent variable is not clear since data bearing on this 

question were not available, * . 

" ■« • . 

Regardless of the reason for this anomaly, it does affect, in 

U • 

an^iiiq>or^ant way, the effect of adjimct pre-question group performance on 

the static comparison and trend items contained in the criterion test. In 
the trend *pre*quest ion treatment group, where specific amount learning was 
relatively high, the expected result occurred — i.e., the trend item mean 
was significantly higher than the static comparison item mean 
(t « 2.79; within cells, df « 84; p .OS)/ However, in the static pre- 
question condition where specific -amount learning was very low, mean perfor-tf 
mance on static compa?rison criterion questions did not significantly exceed 
mean performance on the trend questions. The most plausible explanation for 
this nonsignificant result is the inadequate specific amount learning in .this^ 
group , 



. ^ ' .• . 10' 
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The irrelevant pre-question group exhibited the same meaa perfor- 

nance pn both static comparison and trend items, as expected. An important 

4iapXication o| this result is that the /static comparison and trend items 

* are equally d.ifficult, thus ruling out differential item difficulty (i.e.T . 

' , static, comparison vs.. trend item types) as a rival hypothesis for the. 

' . ' . ---- , 

organization results discussed earlier. 
4 The combination pre-question* treatment " group produced the most 

. surprising result, i.e., mean performance on static comparison items sig- 
- ' nificantly exceeded mean performance on the trend items ^oniEcfroni^t = 2.81, df = a4, 

p <..05). It was expected that the orienting effects of a combination of ' 
static comparison and trend prequestiona would facilitate performance 
. . equally on both static comparison and trend test items; thus, the low 

trend item mean was unexpected, there are two possible explanations for 
• this result:' (a) the orienting effects of static comparison questions 
may have been greater because these items appeared last in all booklets 
for this group and were thus the last items encountered before the test 
. * graph was- presented, and (b) when told to maximiz^^performance on both 
- trend and static comparison questions, Ss tended to perceive the static 
comparison questions as being dominant. Given the trend information 
learning set suggested above^-static comparison pre-questions would have 
been somewhat incompatible with the learning set an.d hen^e may have 
J. "stool out;" thus, exerting more influence on subject inspection of the 

test graph than' the trend:, questions. These 'explanations are speculative 
at this point but can easily be te'sted in subsequent studies. ; 

The third significaiit effect^item type X graph- form interactions 
(F--6.87;df«2,8^ p^.Ol) was not of primary concern in the present study. 
The. two graph forms were employed only to insure greater generalizability 
of the results. Further analyses of the data will be carried out in the 
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future to determine the relationship between graphical configuration 
and performance on these three item types, but since this is not of 
concern in the present study, this interaction is not discussed further 
here. 

In sum, the data suggest that subject to the demand characteris- 
tics of the present" study, i.e., three-minute study time, three X four data 
matrices, etc.. Ss tend to study specific point information regardless of 
the organization of the graph they Are instructed to study or the type rof 
adjunct pre-question used. However, performance on the two-point items 
emploved here seemed to be influenced both by graph organization and by 
type of pre-question employed. The data suggest that organization is 
most important with respect to performance on static comparison items. 
Pre-questions have an effect; but the eJcact nature of this effect is 

9 

not made clear by these data. Performance on trend questions seems to 
be facilitated by pre-questions; however, these data do not allow the 
'same claim to be made for the static comparison pre-questions , princi- 
pally because of the relatively poor overall performance of the group 
receiving these questions. Additionally, the effect of using^several * 
types of pre-questions simultaneously is in need of further study. 

Conclusions 

The results strongly suggest that further investigation shcwld 
be carried out with respect to the organization and adjunct question 
vatri-ables since botih may play an important role in shaping the acquisition 
of quantitative information frcni bar graphs. The end results of studies 
of this sort should provide clearer guidelines for curriculum builders and 
teachers interested in facilitating specific kinds of acquisition of 
Information from graphical displays included in instructional materials. 
1 limitations of this study do not permit the formulation of hard and 



fast rules governing choice of organization and the optimal use of 
adjunct questions. However, the results are encouraging t:lnce they 
suggest that a formulation of such guidelines is within reach and 
could be developed within a reasonably short period of time. 
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Table I 

Results of the Neuman-Keuls test on Differences among 
types of INTERVAL LEVEL ITEMS 





h 




^3 


X- (trend) = 2.50 
X«° (static comparison) = 2.64 
(specific amount) = 3.40 


■ 


-A 

.14 


.90* 
.76* 



p 



4 Table- II 

Mean Performance on Three Types of Ordinal Level Items under Two Typ 
of Graph Organization 



^vx^rganizat'ion 
Item type ^"v^ 


Dynamic 
(n»28) 


Static 
(n«30) 


Overall Mean 


Trend . 


4.11 


4.00 


4.05 


Static comparison 


3.64 


4.53 


4.10 


Specific amount 


4.36 


4.30 


4.33 


Overall mean 


4.04 


4.28 


4.16 



15 

' ^ - Table , III 

Mean Performance on Thres Types of Ordinal Lev^l Items under Four Adjunct 
Pre-question Conditions ^ 



"""Vs^ Pre-question 

type 

Item type 


.Trend 
. (n=15) 


Static 
Comparison 
(n=U) 


Combination 
(n«15) 


Irrelevant. 
(n«17) 


«» 

Trend 


4^93 


3.18 


3.60 


4.24 


Static comparison 


3.87 


3.45 


4.67 


4.24 


Specific amount 


4.80 


C 

3.09 


4.33 


4.71 



4.53 3.24 4.20 . 4.40 
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